"The highlighted tokens are primarily function words, common particles, conjunctions, pronouns, and frequently used morphemes in Vietnamese, as well as punctuation and quotation markers. These tokens are essential for sentence structure, grammatical relationships, and discourse flow, often marking beginnings, endings, or transitions in sentences and direct speech."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.83 | 0.946 | 0.7 | 0.805 | 0.7 | 0.96 | 0.04 | 0.3 |
fuzz | 0.78 | 0.804 | 0.74 | 0.771 | 0.74 | 0.82 | 0.18 | 0.26 |